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Analysis of Exception Data in a Staging Hierachy 



Abstract: This paper is an analysis of program address trace data in a demand-paged computer system with a three-level staging hier- 

archy. Our primary objective is to explore the data both graphically and numerically, using methods that may be useful when other data 
traces become available. In addition, plausible point-process type models are fit to the data. Such an approach, combining data-analytic 
procedures with probability modeling, should prove useful in understanding program behavior and thus will aid in the rational design of 
complex computer systems. 



1. Introduction 

Although a number of stochastic (queuing) models for 
the structure of multiprogrammed computer systems 
operating under demand paging have been proposed and 
studied, e.g., [1-4], the probabilistic representation of 
the behavior of programs running in such systems has 
received relatively less attention (however, see [5, 6] 
for examples of two complementary approaches to the 
formulation of program behavior models). In view of 
the necessity of understanding the referencing patterns 
of programs in order to improve the decision algorithms 
in current and future systems, further studies of program 
behavior leading to the mathematical characterization of 
computer system workloads are appropriate. 

This paper reports results of a study aimed at better 
understanding program reference patterns in a demand- 
paged computer system with a three-level staging hier- 
archy. The approach taken is, first to represent the actual 
program-address trace data and, second, to fit the latter 
with plausible stochastic models. The point of view taken 
is rather similar to that of [5] concerning the modeling 
and analysis of page exceptions in a two-level memory. 
However, in this paper we have emphasized the use of 
simple graphical methods of statistical data analysis 
and modeling rather than more formal and complex sta- 
tistical techniques such as spectral analysis (cf. [7]). 
Throughout this study we have used an interactive 
APL/360 computing system, a tool which we have found 
well suited to this type of statistical analysis and modeling. 

The stochastic processes studied here occur in a 
three-level staging hierarchy. A description of the hier- 
archy that we assume and of the stochastic process 



models of interest that suggest themselves therein are 
given in section 2. The sense in which the exception 
process in the staging hierarchy can be viewed as a bi- 
variate point process (see [8]) is discussed briefly in 
section 3, and section 4 contains a description of the 
data available for analysis. The data analysis and model- 
ing of exception processes are given in sections 5-8. 
Estimates of values of the parameters in the exception 
process model are presented in section 9. Section 10 
contains an assessment of the fit of the model, and sec- 
tion 1 1 gives a summary of the results and conclusions. 



2. Description of the staging hierarchy 

The data sequences studied in this paper occur in a de- 
mand-paged computer system having as a storage struc- 
ture a three-level staging hierarchy, as described in [9]. 

In such a system all information that is explicitly ad- 
dressable is divided into units of equal size called blocks , 
each of which is further divided into units of equal size 
called pages. Level 1 of the hierarchy (the execution 
store) is similarly divided into page-size sections called 
page frames and levels 2 and 3 of the storage hierarchy 
are divided into block-size sections called block frames. 

In such computer systems it is possible to execute a 
program by supplying it with only a few page frames and 
block frames of storage. When the page containing the 
first executable instruction has been loaded into a page 
frame, execution begins and continues until some re- 
quired information is not in the execution store. An 
attempt to reference information not currently contained 
in level 1 is termed an exception. When a “demand” for 423 
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Figure I Staging hierarchy. 



a page occurs, the page containing the required informa- 
tion is staged through adjacent storage levels up to the 
execution store in accordance with a prescribed regime 
for hierarchy management. Thus the hierarchy is linear , 

1. e., there are data paths only between adjacent levels, 
and data in level 3 must pass through level 2 before going 
into level I. 

In the three-level staging hierarchies we consider (see 
Fig. I), information is transmitted between levels 1 and 
2 of the hierarchy in page-size units. The size of a page, 
in bytes, is denoted by b } and the page capacity of level 
I is denoted by c v Thus b l c l is the total number of bytes 
of information which can be contained in level 1. Sim- 
ilarly, information is transmitted between levels 2 and 3 
of the hierarchy in block-size units, consisting of an in- 
tegral number of pages. The byte size of a block is de- 
noted by b 2 . The block capacity of hierarchy level 2 is 
denoted by c 2 , and thus b 2 c 2 is the byte capacity of level 

2. Level 3 of the hierarchy is considered to be of sufficient 
capacity to contain all information that is explicitly 
addressable in the computer system. 

The staging hierarchy is assumed to be managed under 
the least recently used (LRU) replacement policy in 
which reference is broadcast to all levels of the hierarchy. 
Specifically, if the page containing the required informa- 
tion is currently in level 2 of the hierarchy, the page is 
fetched (page pull) from level 2, overwriting some page 
currently in level 1. In general, this replaced page must 
be written down into level 2 (page push). The page se- 
lected to be overwritten is the page in level 1 which has 
been referenced the least recently of those in this ex- 
ecution storage level i.e., the least recently used page. 
An instance of an exception of this type, in which the 
required page is found at level 2 of the hierarchy, is 
termed a “hit to level 2.” 

Upon an attempt to reference information neither in 
level I nor in level 2, the page containing the required 
information is staged up from level 3 as follows. The 



block containing the desired page is fetched (block pull) 
from level 3, overwriting the least recently used block 
in level 2. Again, in general, this replaced block must be 
written down into level 3 (block push). Now that the 
block containing the required page resides in level 2, the 
required page can be transmitted to level 1 (via a page 
pull and a LRU page push) and the reference can be 
executed. An instance of an exception of this type, in 
which the required page is not found at level 2 but only 
at level 3, is termed a “hit to level 3.” In the sequel, we 
shall use the term staging hierarchy to mean a three-level 
staging hierarchy managed under the LRU replacement 
policy. 

There are many related (but not necessarily equiva- 
lent) data sequences that describe page reference pat- 
terms in a staging hierarchy: important examples are 
listed below. 

1. References {/?.(/?)}, i.e., sequences of page refer- 
erences for pages of size /?, where R { (b) is the name 
of the page referenced at (discrete) time /. 

2. Distances {Dfb)}, i.e., sequences of stack distances 
for LRU replacement, as defined in [ 10], where Dfb) 
is the total number of distinct pages (of size b) refer- 
enced since the last reference to Rfb). 

3. Sequences corresponding to exceptions to either level 
for various capacities at levels 1 and 2. We denote 
such a sequence by {T.(c v c 2 ; b v b 2 )}, where 
T.(c v c 2 ; b v b 2 ) is the time (in references) of the yth 
exception in a three-level staging hierarchy in which 
level 1 contains c\ pages of size b x and level 2 contains 
c 2 blocks of size b 2 . 

4. Sequences corresponding to exceptions of two types. 
We denote such a sequence by {r.(r p c 2 ; b v b 2 )\ 
hj(c v c 2 \ b v b 2 )}, where T.{c v c 2 : b v b 2 ) is the time 
of the jth exception and h.(c v c 2 \ b v b 2 ) equals 2 if 
the y'th exception is a hit to level 2 and h.(c v c 2 \ b v b 2 ) 
equals 3 if the yth exception is a hit to level 3. This is 
a complete description of the pattern of exceptions. 

We note here that this last sequence of exceptions of 
two types is related to distance sequences by the follow- 
ing result (derived in [9]). The relationship facilitates 
the collection of data on the sequence of exceptions of 
two types. The bivariate sequence of exceptions of two 
types can be obtained from two distance sequences 
{D i (b l ) } and {D.(b 2 )}. 

Proposition 1 

Provided that c 2 > c v if T j {c v c 2 \ b v b 2 ) = /, then 

j 2 if DfbJ > c x and D.(/? 2 ) < c 2 
lij(c t , c t : b v b 2 ) = | 

[3 if D,(*,) > c, and D,(i> 2 ) > r 2 .(l) 
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